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This study compared the effectiveness of two i nstnjctional methods — problem based i nstruction withi n a face-to-face context and computer-mediated partici pafory 
simulation — in increasing students’ content krowiedge and application gains in the area of information problemsolving The instructional methods were implemented over a 
four-week period. Atv\o-group, pretest- posttest, randomized control design coupled with an independent sample t-test on learning group gains was used to examine 
effectiveness. The resuits of this stucVsho/vthat the simulation group experienced significant overall (which nders to combined knowledge and application abilities) gains 
from pre- implementation to post- implementation (T =1.852, p =.04*); however, as we divide overall development into its constitutive parts, the results suggest that the two 
instructional methods may have distinctly different affordances. 


The following statement 'Immersive spaces are good for learning,” is an emergng academic position and area of research (Shaffer etal. 2005; Gee 2005; Shaffer 2008; 
Aldrich 2005) that has the potential to augment teaching and learning practices within many K- 12 subject areas, including information problemsolving instruction. As an 
academic position, the view/ of immersive environments (e.g., video games, computer games, simulations, and desktop virtual reality environments) within the instructional 
landscape is theoretically persuasive. VNithinthis position, immersive technologies are viewed as potentially powerful learning spaces that could be integrated into the 
teaching and learning context In other words, virtual worlds could be integrated into the education landscape if they are developed using immersive technology and focused 
on learners solving complex problems within a community of practice (Shaffer etal. 2005). This academic position accords well with the relatively recent move toward 
authentic disaplinary practices — a sociocultural view/ of teaching and learning reflected in marry journal publications and standards documents such as the National Council of 
Teachers of Mathematics (2000) and the National Research Council (1996) — that refer to an approach to student learning that requires thereto engage the practices of 
spedalists within disciplines (e.g., historians, scientists, mathematicians, and information specialists) instead of simply learning the facts associated with those disciplines 
(Ford and Forman 2006). In concert with the disciplinary-practices view/ of teaching and learning, it is argued that complex and i rmrersive teach ng environments could 
augment learning by presenting new social and cultural worlds that allow students to partidpate in newsodal practices and take on new identities (Shaffer et al. 2005). 

As an area of research, empirical evidence is needed to illuminate the effectiveness of these environments within the K-12 IL instructional landscape This study compared 
the effectiveness of a face-to-face, problem- based instruction method to a computer-mediated participatory simulation (see figure 1). The problem based method uses 
instructional opportunities that require students to learn information problemsolving by engaging real-world, complex problems with uncertain and multiple i rforrmtion 
solutions (Blumerfeld et al. 1991). The participatory simulation method requires students to develop subject-sped fic literades through simulated experiences, interactions, 
and communities of practices. Moreover, within the simJation method, students learn problemsolving practices by actively participating as information literacy (I L) 
apprentices within a computer-generated community of information professionals. 


The development of computer information systems, ideas cf an information-based society, and an alarming report (National Commission on Excellence in Education 1983) on 
the status cf American education created a dynamic stage-setting tor the development of a K-12 I L discourse. \Aithin that setting library and information sdence (US) 
scholars and i nforrration organizations worked to develop the discourse withi n the K- 12 educational landscape. \ATiilethe list of discursive contributions is very long, there 
are some seminal moments during the discursive development of I L. For example, research conducted by Irving (1985) found that educators valued skills needed to I earn 
from information resources more than skills associated with the retrieval of resources. Scholars (e.g., Mancall, Aaron, and Vteilker 1906; C raver 1989) created a nexus 
between the concept of I L and the skills tied to critical thinking. Carol Kuhlthau (1987) illuminated the historical developments of the information literacy discourse and 
encouraged school library media specialists (SLMSs) to make integrated IL instruction a primary aspect of their programs. Breivik, Hancock, and Sem (1998) promoted the 
shift ffoma technology-focused IL discourse to a skill-focused dscourse. The ALA Presidential Committee on Information Literacy articulated a definition of IL and 
recommendations for furthering the concept within areas such as primary and secondary education (ALA 1989). The National Forum on Information Literacy (NFIL) — a 
coalition of education, business, and government organizations — formed to advance the concept within various domains of study and practice, inducing K- 12 education. A 
Delphi study conducted by NFIL members tied the concept of I L to national education goals, and Doyle (1994) further articulated the possibi I ities of I L within national goals. In 
a position statement the VNisconsin Education Media Association (V\^MA), endorsed by the American Association of School Librarians (AASL), positioned information 
prod em-sdvi ng content and practices (i.e., identifying tasks, employing search strateges, locating resources, accessing information physically and intellectually, interpreting 
information, communicating information, and evaluating the prod em-sdvi ng product and process) as the central focus cf I L teaching and learning on the K- 12 level (V\^MA 
and AASL 1993), and the AASL cdlaborated with the Association for Educational Communications and Techndogy (AECT) to pudish IL standards (AASL and AECT 1998). 

I ifom fltion FYofejIem- Solving 

Information prodemsdving instruction refers to the teaching and learning of practices related to the creation of information sdutions to proderrE. The framework that 
underpins the concept is a process-oriented one, and a dominant theme that runs through the concept is the coupling of practices needed to access and use information with 
those needed to apply and solve information prod errs (Wdf, Bush, and Saye 2003). The constitutive practices cf information prodemsdving are identifying tasks, employing 
search strategies, locating resources, accessing information physically and intellectually, interpreting information, communicating information, and evaluating the prod erm 
sdving product and process. Task identification (also known as prodem definition) refers to a practice of recognizing the existence of an information-based prodemand 
defining the needs associated with that problem (V\iEMA and AASL 1993). Search strategy initiation refers to the development of a plan that will be employed to find 
information. Information location refers to an adlitytofind resources within information landscapes and information within particular resources. Information evaluation refers 
to the determination of information accuracy, comprehensiveness, relevance, and usefulness. Information use refers to the integration and synthesis cf i nforrration to sdve a 
defined prodem I nfomration communication refers to the effective presentation of prodemsolvi ng resolutions. Prodemsolving product and process evaluation refers to a 
critical assessment of the final resdution of a prodemand the processes employed in generating it 

Integrated IL Instruction 

The AASL promotes the foil i (legation of I L skills within the teaching and learning landscape (AASL and AECT 1998), and presently, SLMSs are primarily employing 
integated approaches to information prodemsdving instruction, which are cdlaborative efforts between SLMSs and subject area educators to contextualize information 
prodemsdving content and practices within ongoing classroom instruction (Thomas 2004). Furthermore, since information prodemsdving has a process orientation, 
cdlaborating educators have trad tjonally used instructional methods (e.g, resource- based learning, project-based learning, and inquiry learning) within integrated 
approaches (Eisenberg, Lowe, and Spitzer 2004; Thomas 2004). AASL strongly promotes the idea cf 'library media specialists working] with teachers to plan, conduct and 
evaluate learning activities that incorporate information literacy" (AASL and AECT 1998, 50), and much cf the K- 12 research literature (eg., Irving 1985; Pitts 1995; Thomas 
2004; Todd 1995) seems to support the idea cf integration. For instance, Todd (1995) examined the use of irtegated IL instruction with middle schod sdence students and 
found a positive effect on learning Bi ngham ( 1994) compared an integrated information skills approach with a traditional [noncontextualized] approach and reported 



significantly Nearer scores for students learning vuthin the integated approach Pitts (1995) tbund integrated instruction necessary because corrplex information assignments 
and activities require students to use rrultiple domains of knowledge inducing subject matter and IL knowledge. Hara (1996) tbund integrated IL instruction more effective 
than both no instruction and noncontextual ized instruction. 

It is currently best practice to use process frameworks in conjunction vuth integation and instructional methods (Thomas 2004). Process frameworks are user-centered, 
cognitive frameworks that focus on strategies for thinking during research and problem-solving activities (Thomas 2004). Examples of process frameworks indude the Inquiry 
Model (Sheingold 1986), Irformation Search Process (Kuhlthau 1988), Big6 (Eisenberg and Berkov/utz 1990), React (Stripling and Pitts 1988), Pathways to Knowledge 
(Pappas andTepe 1997), and I -Search (| oyce andTallman 1997). Scholars like Eisenberg and Brown (1992) propose that there are more similarities than differences among 
the frarnaAorks because they all guide students through an iterative process of solving an information-based problem or research project 

The general benefits of integrated IL instruction have been articulated through both anecdotal and empirical evidence. However, postsecondary research is ind eating a lack 
of undergraduate I L competencies and abilities. Moreover, studies are indicating a lack in students’ information confidence (National Center tor Postsecondary Improvement 
[NCPI] 2001), ability to formulate and locus research questions (Fitzgerald 1999; Quartern, 2003), ability to access information (Intersegmental Comrrittee of the Academic 
Senates [NCAS] 2002; NCPI 2001; Quartern 2003), abi I ity to evaluate information (I CAS 2002; Dum 2002; Fitzgerald 1999), ability to organization information, and ability to 
create and communicate information (Dunn 2002). Errergng postsecondary research indicates that much remains to be done in the area of I L instruction. In other words, 
there is a continuous need tor the interrogation and augmentation of current best practices, particularly integrated instructional methods. More empirical evidence is need to 
iNurninatetheaffordances and effectiveness of dominant integrated instructional methods (such as problem based learning), and empirical interrogations of dominant 
methods as compared to emerging methods (eg., computer-mediated methods) are also needed. 

IrrmErsh^e Instructional Methods: An Emercpng School afThou^nfcand Research 

Immersive instructional methods have the potential to expand the range of instructional practices vuthin the area of K-12 IL education (Shaffer etaf 2005; Gee 2005; Shaffer 
2007; Aldrich 2005). Immersive instruction refers to the coupling of learning theory, domain-specific knowledge, practices, and technology (eg., videogames, computer 
games, simulations, and desktop virtual real ity environments) to create pewerful learning environments (virtual worlds). These virtual learning environments allow students to 
I earn new social practices (eg., infbrrration-l iterate practices) and develop new identities (eg., information-l iterate identities) throuch the process of solving corrplex 
prod errs and partidpating in communities of practice (Shaffer etal. 2005). 

Research studies (eg., Randel etal. 1992; Dempsey etal. 1994; Ernes 1997; Harris 2001; Lee 1999; Rosas etal. 2003; Laffey etal. 2003; Rieber 1996; Gorriz and Mediana 
2000; Prensky 2001) gve insight into the affordances of immersive instruction (eg., electronic gaming and use of simulations) wthin the education landscape. Randel etal. 
(1992) examined empirical research studies in the area of gaming and education that were published between 1963 and 1991. This review of research strictly focused on 
studies comparing the instructional effectiveness of games to traditional classroom instruction, and the researchers found that thirty eight of the sixty- seven studies concluded 
that teaching via gaming was just as effective as teaching using traditional practices. The researchers also tbund that twenty-seven of the sixty-seven strides concluded 
instructicrras-garnngtobe more effective then irstiuctionwithintraditional practices. Other empirical research studies showthat gaming approaches are just a effective as 
traditional teaching approaches inteaching basic math and reading comprehension skills (Rosas etal. 2003; Laffey etal. 2003), mathematical problemsolving skills (Van Eck 
and Dempsey 2002), basic logc (Costable etal. 2003), geographical content knowledge (VMebe and Martin 1994; Virvou, Katsionis, and Manos 2005), and vocabulary skills 
(Malouf 1988). The gaming and learning literature has also illuminated particular affordances associated with these learning environments such as the development of critical 
thinking skills (Rieber 1996), problemsolving skills (Rieber 1996; Gorriz and Mediana 2000; Prensky 2001), visual and spatial skills (Greenfield etal. 1994), cognitive 
strategies (Greder 1996), discovery learning (Prensky 2001; Provenzo 1992), student engagement and interactivity (Malone and Lepper 1987; Rosas etal. 2003; Price 
1990), visual skills attainment motor skill guwth, and computer-using skills. 


Research also i nd cates that desktop vi rtual real ity and computer si mulation envi ronments can i reprove the development of subject area knowledge and process ski I Is. For 



exarrple, J cseph Akpan and Thorras Andre ( 2000 ) conducted a study to exarrine the use of a frog dissection sirrulation — as corrpared to traditional approaches — in 
i rrproving students’ knowledge of morphology and anatomy. The researchers found that the simulated dssection group gained significantly more anatomy knowledge, and 
the researchers concluded that computer simulations are effective learning environments that afford students the opportunity to 'Search for meaning, appreciate uncertainty 
and acquire responsibility for their omi learning" (Akpan and Andre 2000, 311). Geban, Askar, and Ozkan (1992) studied the effectiveness of three instructional approaches 
(computer simulation, problem-solving, and traditional) in augmenting students’ chemistry knov\/l edge, science process skills, and attitudes toward chemistry. Researchers 
found that the problemsolving and computer sirrulation approaches were significantly more effective than the traditional approach. V\foodward, Camine, and Gersten (19S8) 
focused on the effectiveness of a computer si mulation as corrpared to a structured teachi ng approach in teaching health knowledge to mildly handicapped students. The 
researchers found that the computer sirrulation group significantly outperformed the structured teaching group in respect to basic facts, concepts, and problemsolving skills, 
with the greatest cffference in the prodemsolving area. David Ange (1996) conducted a pretest- posttest; two-goup, virtual reality study using the VREAM Virtual Reality 
Development System as compared to a conventional instructional method in developing students’ abilities (i.e., visualization, naming, and recognizing). The researcher found 
that the VR learning environment had a slight positive effect on shape visualization and name vuiting; however, the VR environment strongly enhanced the students ability to 
recognize shapes in everyday contexts. Rivers and Vockell (1987) conducted a study to determine if a computer simulation could be used to enhance hic^i school students’ 
problemsolving abi I ities in the area of biology. The study had three groups: (1) unguided dscovery, which provided students with only a brief introduction to the sirrulation 
before use; (2) guided discovery, which provided students with an in-depth introduction and strategies to use in solving simulated prod errs; and (3) a control group, which 
were taught the same topics using lectures, textbooks, and laboratory exercises. Results indicated that students using the unguided discovery sirrulation preformed as well 
as the control group; however, the students using the guided discovery sirrulation significantly outperformed all other students in respect to scientific thinking and critical 
thinking ad I ities. Paul Kelly (1998) conducted a study to determine if students learning within a sirrulation environment could transfer knowledge and perform as well as 
students that received instruction in a laboratory setting The researchers found that the computer si mulation students performed as well as the laboratory students. 

This errerg ng school of thought — that i rrrrersive spaces are good for leami ng — and the technologies tied to it should be errpi rical ly explored withi n the area of K- 12 I L 
instruction. 


This study corrpared the effectiveness of a face-to-face, prod em based instruction method to a computer-mediated participatory sirrulation. The prod em based method 
utilizes instructional opportunities that required students to learn irforrration prodemsolving by engaging real-world, complex prod errs with uncertain and multiple 
irfomration solutions (Blumenfeld et al. 1991). The participatory simulation method requires students to develop subject-specific literacies (e.g., information prodemsolving) 
through computer-simulated experiences, interactions, and communities of practices. 

Three research questions were generated for this study; 

1. Are the overall gains of the two groups (prodembased and simulation) significantly different after a four-week implementation period? 

2. Are the content knowledge gai ns of the two groups (prodembased and simulation) significantly different after a four-week implementation period? 

3. Are the application gains of the two groups (prodembased and simulation) significantly different after a four-week implementation period? 

rypotn eses 

The first hypothesis, which is based upon previous educational research using computer simulations and virtual reality platforms, stated that the participatory sirrulation group 
(PS) would dspfay significantly larger overall gains from pretest to posttest (HI: prodembased group [PB] <[PS]). The second hypothesis stated that the PS would display 
significantly larger content knowledge gains from pretest to posttest (H2: PB knowledge gain <PS knowledge gain). The third hypothesis stated that the PS would display 
significantly larger application gains for pretest to posttest (H3: PB application gain <PS application gain). 



Instructional I^H h o d s Used intHeStucV 


Corrpuher-^MbciatBd Participatory SiinJation 

Athree-dimEnsional, computer generated, participatory si mulation was employed as an instructional method tor problem-solving teaching and learning (see figure 1). The 
simulation, which is constructed upon sococultural learning principles, was the result of a rapid design ethrogaphy that attempted to extend instruction role possibilities for 
SLMSs (Newell 2004). 

The 3D interlace of the simulation was developed using authorware similar to the design tools used within the online virtual world call Second Life. The simulation interface 
was highly interactive and allowed students to navigate the 3D envirorrrent from every perspective using the computer screen, mouse, and keyboard The 3D simulated 
contexts consisted of a middle school library (see figure 2 ), high school library (see figure 3 ), irforrral irforrration environments (see figure 4 ), and electronic environments 
(see figure 5 ). The various contexts were designed to represent a small community or town; in other words, students could virtually walkftomthe middle school library to the 
high school library within the 3D simulation. Furthermore, the 3D simulation technology enabled the construction of virtual information objects, artifacts, and resources (e.g., 
books, computers, televisions, and people). Both the virtual objects and contexts were interactive and responded to the participants’ actions; for example, the virtual 
(simulated) computers worked and students could virtually use many of the books within the space. VMthin the 3D simulation environment students could move and interact 
freely and collaboratively using axeitars, communicate using chat features and gestures, and use a variety of information objects, artifacts, and resources. 

VMthi n the participatory si mJation, students learned information problem-solving practices throuch simulated experiences, interactions, and communities of practices. 
Moreover, students learned problemsolving practices by acti\^ly participating as IL apprentices within a computer-generated community of i rforrration professionals (called 
Cybrarians). As I L apprentices, students consulted the simulated information professionals and assisted them in meeting the information reeds of other computer-generated 
characters within the simulation using novice problemsolving knowledge and practices (Wenger 1998). All information-oriented problems emerged from computer-generated 
characters needng help, and through partidpation students’ learned information practices — gradually developing from novices to masters. Moreover, student learning was 
guided using three techniques: scaffolds, communities of practice, and cognitive process frameworks. First instructional scaffolding helped students as they learned through 
active partidpation, and these learning supports (scaffolds) existed in the form of tutorials, information on-demand, just-in-time pop-ups (Gee 2007 ), coaching, modeling 
(Collins, Brown, and Newman 1989), cognitive structuring (Gallimore and Tharp 1990), exploration (Collins, Brown, and Newnranl989), and questioning (Gallimore and 
Tharp 1990). Second, a community of practice (CoP) also helped the development of practices. Information professionals — a goupthat is bounded by best practice 
approaches to information problemsolving — constituted the CoP, and within the 3D simulation, students could work vwth members of this CoP (e.g., Cybrarians, real-world 
librarians, and other student apprentices) to solve problems. Third, as students engaged tasks, they used a cognitive process framework to cognitively structure the stages of 
information problemsolving and thinking strateges related to the different stages. The stages were task identification, search strategy initiation, information location and 
access, information evaluation, information use, information communication and problemsolving product and process evaluation. 

The initial development of all simulation tasks was done by the researcher. A variety of information literacy and information problemsolving textbooks and artides were 
analyzed and used in the construction of tasks. However, the SLMS and the technology teacher, within the research site, reviewed and augmented all tasks a month before 
the study was conducted. Tasks were also added by the educators during this period. 

FVoblem-Based Instruction within a Face-to-Face Context 

As stated above, it is currently best practice to teach information problemsolving using an integated instructional approach coupled with an instructional method and process 
framework (Thomas 2004; AASL and AECT 1998). Staying true to the integrated approach, the technology teacher and irforrration specialist decided to design a technology- 
focused unit of study that embedded information problemsolving lessons into the class activities. The titie of the unit was Applied Computer Ski I Is, and the general purpose 
was to overview how technology can be used in everyday life. The educators, surprising, began the construction of this unit by examining the participatory simulation tasks 


to determine the prirrary technological applications and problem-solving processes used. For example, rrany sirrulation tasks required students to search for websites and 
watch and listen to online videos and search catalogs; therefore the educators designed the unit vuth daily lessons focusing on those technologies and processes. Second, 
the educators took the 3D sirrulation tasks and restructured them into problem based learning situations to be used as integrated classroom activities that supported the daily 
lesson. The educators dedded to use the sirrulation tasks to ensue that students vuthin both learning environments experienced the same content and similar activities. 

The educators employed the use of a problem based instructional method and a generic process framework. Wthin the problem based method the educators designed 
instructional opportunities that required students to learn information problemsolving by engagng real-world, complex prod errs vuth uncertain and mJtiple information 
solutions (Blumenfeldetal. 1991). These instructional opportunities emphasized student-driven question formulation, multimodal information searching, use of information 
artifacts (e.g., books and computers), sense-making, and mJtimodal information use (Sheingold 1986; Blumenfeld etal. 1991; Callison 1986). Furthermore, all instructional 
opportunities culminated in concrete demonstrations of prodemsdving practices (Blumenfeldetal. 1991; Callison 1986). Curing instruction, the technology teacher and 
irforrration spedalist structured, supported, and guided student-constructed understandings and products (Blumenfeld et al 1991; Callison 1086), and as students engaged 
tasks, students used a generic process-oriented framework that guided them through the stages of information problemsolving and thinking strateges related to the different 
stages. The method also infused aspects of inquiry-learning. For exarrple, students were viewed as self-reflective learners in a meta-cognitive sense, which refers to 
"knowing about [himself or herself] and other people as knowers, knowing about the task to be undertaken, knowing what strateges to apply to the task and hcw/to monitor 
one’s own performance with respect to the task' (Sheingold, 1986, 84). The students are also viewed as active learners that are motivated by the real-world nature of 
problems and multimodal information contexts and learners that actively use prior knowledge in the personal construction of information solutions to problems (Sheingold 
1986). Wthin the instructional method, students were also required to work in teams of two during the completions of tasks (Callison 1986; Bransford and Stein 1993). The 
face-to-face teaching and learning context consisted of a computer lalq middle school library, and all of the information objects and tods vuthin them (e.g., library catalogs, 
books, computers, websites, and search engines). The rridde sc hod, library media center, and computer lab were connected, and the computer lab housed enouc^i 
computers for each student to have his or her own during the learning periods. 


The design consisted of a two-group, pretest- posttest, randomized, controlled trial employed to examine the effectiveness of the two instructional methods. Two seventh 
gade and two eighth grade computer literacy classes (54 students total) were assigned to instructional methods (problem- based or participatory simulation) through a 
randomization process. The researcher attempted to recruit the enti re seventh and eighth grade popuJation of computer lab students for the study (77 students); however, 23 
students were not enrolled or excluded fiomthe study due to a lack of student or parent consent or excessive absences during the four-week implementation period. The 
participatory si mJation goup (PS) was composed of 27 students (12 seventh grade and 15 eighth grade students), and the problem-based group (PB) was also composed 
of 27 students (11 seventh grade and 16 eighth grade students). Both groups were given a pretest, then experienced four weeks of instruction and tested again (posttest). 

FVetests arid Rosttests 

Because of the particuiar aims of the study, it was necessary to develop the test that was to be given as a pretest and posttest The tests were constructed using the concept 
of content validty. Content validity refers to the extent to which a measurement instrument is a representative sample of the content domain being measured (Robson 2002 ). 
Thisformof validity is usually employed when a researcher attempts to assess achievement in a knowledge area (Robson 2002). The researcher used Information Power 
(AASL and AECT 1998) and other seminal information problemsolving publications such as The Definitive Big6 Workshop Hancbook (Eisenberg and Berkcwtz 2003) to 
ensue that the test items were reflective of the content knowledge and skills of the information problemsolving domain. After designing and developing the test, the 
researcher submitted it to a panel of five information educators to both take the test themselves and to provide feedback for augmentation and change The final version of 
the test was composed of two sections: (1) a section with ten best-answer questions that overviewed information problemsolving knowledge and (2) a section that required 
students to complete an irforrration problemsolving activity (see appendix A ). The problemsolving activity was designed to illuminate students’ abilities in solving a problem 
using information actions and processes such as their ability to locate, evaluate, synthesize, and use information. A rating scale — designed by the researcher and augmented 


by the same panel of inforrration educators — was used to grade both portions of the test 

The Testing Situation 

The students arrived to the computer lab, and they were instructed to turn off all computers. The tests were then distributed, and students were asked to print their names on 
the first page, which was the best-answer portion of the test The researcher overviewed the two sections of the test tor students and prodded an initial reading of the 
d recti ons. Students were then given the entire class period to complete the test and were reminded that they would need their computers tor the problem-solving activity 
section of the test The students were permitted to ask questions; however, the teacher and researcher could not define domain-spedfic terms, ideas, procedures, or 
processes. Furthermore, they coUd not provide answers or tips. 

Gracing tire Pretest and Rostteste 

After all tests were completed, the researcher assigned a unique number to each test This unique number was written in two places. First it was placed directly beside the 
students name, and it was also placed on the third page of the test The first page of the test (the best-answer portion) was then graded and removed to ensure a blind 
review/. The researcher also graded the problemsolving activity portion of the teste, andtheSLMS arto technology educator were asked to review all assigned problem 
solving grades for rater reliability purposes. The goal was to achieve 100 percent agreement on grade assignment therefore all rating discrepancies were discussed and 
agreement was achieved through rating darifications or gade modifications. (See appendix B tor the scori nq guide.) 

An independent sample t-test on gains was used in this study, and three hypotheses were formulated and tested. Overall, knowledge and application gains from pretest to 
posttest were calculated. The gain means between the two groups were then compared using t-teste. The test statistic — theT score — was calculated using SPSS software. 
The probability that the null hypothesis is true (the p-value) was determined on the basis of theT score and halved to obtain the p-value for a directional hypothesis (or one- 
tailed test). Finally, the p-value was compared to the predetermined .05 significance level. 


Descriptive Statistics: PB l^bthod 


The average tor the PB pretest score (combined seventh and eic^nth grade classes) was 58.41 percent and the PB posttest average (combined seventh and eighth grade 
classes) was 70.56 percent The PB seventh grade class averaged 60.82 percent on the pretest and 72.36 percent on the posttest The seventh grade PB class averaged 
36.36 percent on the pretest knowledge-oriented section, and 39.09 percent on the posttest knowledge-oriented section. This group achieved a pretest average of 24.45 
percent on the application section and 33.27 percent on the posttest application section. 

The PB eighth gade dass achieved a pretest average of 56.75 percent and 69.31 percent as a posttest average. Furthermore, the PB eighth grade dass averaged 30.38 
percent on the pretest knowledge-oriented section, and 40.63 percent on the posttest kncw^edge-oriented section. This group achieved a pretest average of 26.38 percent on 
the application section and 28.69 percent on the posttest application section. 


Descriptive Statistics: PS MHhod 


The average (combined seventh and eic^ith gade classes) for the PS pretest score was 58.30 percent and the PS posttest average was 75.26 percent Moreover, the PS 
seventh grade dass averaged 5875 percent an the pretest and 74.92 percent on the posttest The seventh grade PS class also averaged 36.25 percent on the pretest 


knowledge-oriented section and 36.67 percent on the posttest knowledge-oriented section. This group achieved a pretest average of 22.5 percent on the application section 
and 38.25 percent on the posttest application section. 

The PS eighth gade class achieved a pretest average of 57.93 percent and 75.53 percent as a posttest average. Furthermore, the PS eighth grade class averaged 37.67 
percent on the pretest krowl edge-oriented section and 37.33 percent on the posttest knowledge-oriented section. This group achieved a pretest average of 20.8 percent on 
the application section and 38.2 percent on the posttest application section. 

Analysis 

Each of the three hypotheses was tested using independent sarrplet-testconrparing student gains fiom pretest to posttest 

• Hypothesis 1. Thefirst hypothesis statedthatthe PS learners would have significantly higher overall mean gain scores from pretest to posttest Hypothesis 1 was 
supported. There was a significant difference (T =1.852, p =.04*) between the overall PB and PS gains after the 4- week implementation period (see table 1 ). 

• Hypothesis 2. The second hypothesis stated that the PS learners would have significantly higher mean gains scores on the knowledge section from pretest to posttest 
Hypothesis 2 was not supported. There was a significant difference but not in the direction anticipated. The PB learners experienced significantly larger knowledge 
gains (T =-3.664, p =.00 + ) after the 4- week implementation period. Furthermore, data suggests that the PS students made no knowledge gains during the 4-week 
period (see table 2 ). 

• Hypothesis 3. The third hypothesis stated that the PS learners would have significantly higher mean gains scores on the application section fiom pretest to posttest 
Hypothesis 3 was supported. There was a significant difference (T =3.873, p =.00+0 between the PB and PS application gains after the implementation period (see 
table 3 ). 


The pretest results for all classes (5835 percent) suggest that students did not fully gasp the major areas of information problemsolving before instructional implementation. 
Students averaged 34.93 percent on the section of the pretest that asked them content knowledge questions about information literacy in the context of problemsolving, and 
their average was worst (23.57 percent) on the section that required themto apply practices such as problem drfniti on, access, equation, analysis, synthesis, and use. The 
pretest results were reflective of K- 12 information literature. In particular, the results refect the problems that the literature has illuminated in respect to middle school and 
high school students' ability to define a problem ( Loerke 1994; Mark andj acobson 1995), identify types of information needed (Akin 1998; Pitts 1995), locate information 
(Chen 1993; Irving 1990; Neuman 1995; Solomon 1994; Todd 1998; IMahl and Harada 1996), and evaluate and select information (Fitzgerald 1999 Irving 1985; Hirsh 1998). 
The results also support recent studies indicating that students strugc^e in these areas (e.g., accessing, evaluating, analyzing, synthesizing and applying information) during 
their first year of college (Dunn 2002; I CAS 2002). It was quite apparent that at the onset of instructional implementation students struggled in respect to answering questions 
regarding typical information literacy knowledge i n the context of information problemsolving and students struggled in respect to understand ng and applying information 
problemsolving practices (e.g., access, evaluation, and use). 

After the four-week implementation period, an examination of mean gain scores between groups suggested that the PS approach was more effective in expanding students’ 
CMerall development — which refers to combined knowledge and application abi litres — in the area of irformation problemsolving. Moreover, the PS learners experienced 
significant (T =1.852, p =.04+) overall gains from pretest to posttest; although both instructional methods constituted ideal, high-performing learning systems. However, as 
we divide overall development into its constitutive parts, which are knowledge expansion and application expansion, then the significant overall differences can be better 
placed into focus. For instance, the PB students experienced sicpificandy higher gains on the knowledge section of the information literacy test from pretest to posttest (T =- 
3.664, p=.00 + ). In respect to knowledge gains, PS students were simply outperformed by a gain of 7.56. Intact; the data indicates that the PS group made no kncw/edge 
gains during the four-week learning period, which means that their means at pretest and posttest were exactly the same. This finding provides some insight into potential 


affordances tied to face-to-face PB approaches. Moreover, this finding is bel ieved to largely resiJtfromthe types of teaching and learning that is possible vuthin the real-world 
PB method 


\Afrhin the PB instructional approach, the infbrrration specialist and technology teacher engaged in a very hic^i level of direct and dynamic information problem-solving 
instruction (eg, lecturing modeling successful performance, and demonstrating important information problemsolving skills). Furthermore, vuthinthe PB approach, the 
educators did not structure a typical lecture environment in wbich the tBacher takes on the role of a performer and the students play the role of an audence. Instead, both 
educators and students acted as performers wthin the instructional environment The educators were very skilled at (1) questioning students in ways that transformed them 
into cocreator of the overall lecture message, (2) eliciting questions that helped to deconstruct information problemsolving into its constituent parts, (3) elidting students' 
experiences to illustrate specific practices related to the problemsolving process, and (4) engaging students in practical demonstrations to reinforce content This 
combination of dynamic lecturing, modeling, and demonstrating was very effective in teaching students about the components of the information problemsolving process and 
general IL kro/Jedge. 

The PS students are believed to have not made gains in the kncvJedge expansion area for two primary reasons: educators’ lack of student engagement vythin the si mJation 
space and lack of time for knowledge development First, the simulation environment was not designed to replace real-world educators. Instead, the simJation was designed 
to have a continuous (live) educator presence vuthin the virtual environment to engage students inSocratic questioning, reflective thinking, and process modeling. The 
Cybrarians ( preprogrammed computer-generated I i brarians) wthi n the si mulation envi ronment were not designed to serve as pri rrary educators; i nstead, they were designed 
to assistthe live educators in sharing the range of knowledge and practices required to solve problems within and across contexts. Although the researcher attempted to 
engender a seme cf educator ownership into the simulation environment by having a period in wbich the educators augmented the tasks of the envi ronment and by 
conti nuouslydscussing the importance of the live educator's role wfrhin technology-based instruction, educators seemed to feel that they were in d rect competition vuth a 
computer program Moreover, it was very common for educators to use the phrase “our students” wben speaking about the PB goup, and their level of student engagement 
with the PS group deviated fromthe researcher's articulated expectations. The lack of engagement required students to almost exclusively rely on preprogarrmed 
Cybrarians (or librarian-bats) for knowledge and practices. Second, students were expected to learn knowledge of the problemsolving domain overtime through interactions 
and activity — notina lecture format PS students may not have had enough time to gain knowledge of the ful I range of acceptable and typical content within the infbrrration 
problemsdving domain, wbich is evident by the fact that they were more likely to incorrectly answer the 'dll of the above” questions during the posttest 

The PS students achieved significantly higher gains in the area of information problemsolving application from pretest to posttest (T =3.873, p =.00*), and this finding 
provides some insight into potential affordances tied to the use of simulation environments in mediating IL instruction. The simJation emphasized the contexts vuthin which 
irformation literate practices occur and the idea of learning within sodal activity and communities of practice. Moreover, information literacy learning did not occur outside of 
irfomration contexts and participation in the infbrrration practices tied to the infbrrration dorraim The seemly infinite, complex, 3D, computer-based environment coupled with 
a compelling storyline that made students a part of a community of practice (infbrrration studies) may have encouraged students to develop information processes and 
practices for the purposes of understanding, navigating, and using the rrary information environments and artifacts wthin the space It may also have engaged the students 
in a cufture of sharing knowledge, practices, processes, and experiences to fulfill their role vuthin the simJation. The PS group emerged as a process-ori ented goup; they 
focused more on developing information problemsolving practices. The PB group — on the other hand — was more product oriented; students were focused more on 
generating a product to be gaded than developing problemsolving practices. Furthermore, PB students did not seem to engage information problemsolving practices as 
needed processes to successfully adcbess the scenarios; instead, they engaged practices as something that they were forced to do. PB students focused on the completion 
of as many scenarios as possible within the class period, instead of focusing on the ful I development of their ski I Is and fully addressing the scenarios. 


V\fe should not take an either/or approach to I L instruction; instead, we must expand our range of instructional approaches on the basis of effectiveness and affordances. The 
PB method coupled with a high level of direct and dynamic instruction seems to be very effective in presenting content knowledge, and the PS method coupled vwth 



scaffolding, CoP, and process frameworks seerrs to be very effective in teaching the application of IL practices. Bath approaches should be used to develop the type of 
irforrration-l iterate students that our field desires. However, we rrust atterrpt (via research studies, learning theory, and instruction systems technology') to decrease the 
affordance gap between the two approaches. For exarrple, the findings of this study suggests that learning within the two approaches is dsti net and that the two approaches 
have the potential to construct distinct types of infomration-l iterate learners (i.e, learners skilled in content knowledge and learners skilled in the application of infbmration 
practices). Research studies that atterrpt to illurrinate dynarric activity patterns within I L learning approaches are needed to give greater insight into student learning and 
instructional affordances and to generate design recorrmendations that could decrease the distance between attendances tied to particular instructional approaches. 

V\£rks Cited 

Ainge, D. 1996. Upper prirrary students constructing and exploring three dimensional shapes: A comparison of virtual reality with card nets. J oumal of Educational 
Computing Research 14: 345-69. 

Akin, L. 1998. I rforrration overload and children: A survey of Texas elementary school students. School Ubrary Med a Quarterly. 
vwwv. ala. orryala/mcrps/divs/aasl/aasl pubsandjoumals/sl nrrt/sl mrcontentsA/ol umell998sl mqc/aki n.cfm Accessed Dec. 4, 2008. 

Akpan, J . and T. Ancte. 2000. Using a computer simulation before dssection to help students learn anatomy. J oumal of Computers in Mathematics and Sdence Teaching 
19: 297-313. 


Aldrich, C. 2005. Learning by doing: A comprehensive gude to simulations, computer games, and pedagogy in e-leaming and other educational experiences. New/ York: 
\Ailey. 

American Association of School Librarians (AASL) and Association for Educational Communications and Technology (AECT). 1998 Information power: Building partnerships 
for learning. Chicago: ALA 

American LibraryAssodation (ALA). 1989. Presidential committee on i rforrration literacy, final report Chicago: ALA 
wAAw.ala.crc/ala/rrcrPS/dvs/acrl/piJdicatiors/wfoitepapersforesidsritial-cfrn Accessed Dec. 4, 2008 

Bingham J ■ 1994. A comparative study of curriculumintegrated and traditional schod library media programs: Achievement outcomes of sixth-grade student research 
papers. EdD dissertation, Kansas State University, Manhattan. 

Blumenfeld, P. etal. 1991. Motivating project-basing learning: Sustaining the doing, supporting the learning. Educational Psychology 26: 369-98. 

Bransford, J . and B. Stein. 1993. The IDEAL problem solver. New York Freeman. 

Breivik P., V. Hancock andj . Sern. 1998. A progress report on information literacy An update on the American LibraryAssodation Presidential Committee on Information 
Uteracy Final Report Vteehington, D.C.: ALA wAAw.ala.crc/ala/rrcrps/divs/acrifoLfol ications/whitepapersforogessreportclm Accessed Dec. 4, 2008 . 

Callison, D. 1986 School library media progams and tree inquiry learning. School Ubrary Media Quarterly 15: 20-24. 


Chen, S. 1993. A study of high school students’ online catalog searching behavior. School Ubrary Media Quarterly 22: 33-40. 


Collins, A, J . Brown, and S. Newman. 1989. Cognitive apprenticeship: teaching the crafts of reading, writing and rratherratics. In Knowing, learning and instruction: Essays 
in honor of Robert Glaser, ed. L. B. Resnick, 223-53. Hillsdale, N.J .: Lawence Erlbaum Associates. 

Costabile, M. etal. 2003. Evaluating the educational irrpactof a tutoring hypermedia for children. I rformutian Technology in CNIdhood Education Annual, 289-308. 

C raver, K. 1989. Critical thinking: Implications from research. School Library Media Quarterly 18: 13-18. 

Derrpsey, J .etal. 1994. \Afoats the score in the garring literature? J oumal of Educational Technology Systems 22: 173-83. 

Doyle, C. 1994. Information-literate use of telecomrrunications. DMLEAJ oumal 17: 17-20. 

Dunn, K. 2002 Assessing information literacy skills in the California State University: A progess report J oumal of Academic Ubrarianship 30: 26-35. 

Eisenberg, M., and M. Bruwm 1992. 'Current themes regarding library and information skills instruction: Research supporting and research lacking. "School Library Media 
Quarterly 20: 103-09. 

Eisenberg, M., andR. Berkowitz. 1990. Information problemsolving: The Big SixSkills Approach to library and information skills instruction. Norwood, N.J .: Ablex. 

. 2003. The Definitive Big6 XAforkshop Hancbook VN/brthington, Ohio: Unworth. 

Eisenberg, M., C. Lowe, and K. Spitzer. 2004. Information literacy: Essential skills for the inforrration age. VNfestport, Com.: Ubraries Unlimited. 

Ernes, C. 1997. Is Mr. Pac Man eating our children? A review of the impact of video games on children. CanacfanJ oumal of Psychiatry 42: 409-14. 

Fitzgerald, M. 1999. Equating information: An irformation literacy challenge. School Ubrary Media Research 2 

vwwv. ala. orcy'ala^mcrps/divs/aasl/aasl puteandjoumals/sl rrrtysl mrcoritents/vol ume2199gyvol 2fntzgerald.cfm Accessed Dec. 4, 2008. 

Ford, M. J ., and E. A Forman. 2006. Redefining Dsaplinary Learning in ClassroomContexts. Review of Research in Education 30: 1-32. 

Gal I i more, R. and R. Tharp 1990. Teaching mind in society teaching, schooling and lierate dscourse. I n Vygotsky and education: Instructional implications and applications 
of sodohistorical psychology, ed. L. C. Moll, 175-205. Cambridge, U.K.: Cambridge Univ. Pr. 

Geban, O., P. Askar, and I. Ozkan. 1992. Effects of computer simulations and problemsolving approaches on hicji school students. J oumal of Educational Research 86: 5- 
10 . 

Gee, J . 2005. VMrat video games havetoteach us about learning and literacy. New York: Palgrave Macmillan. 

. 2007. VMrat video games havetoteach us about learning and literacy. New York Palgrave Macrrillam 

Gredler, M. 1996. Educational games and simulations: A technology in search of a (research) paradigm I n Handbook of research for educational communications and 
technology, ed. D. H. J onassen, 521-39. New York Macrrillam 


Greerfield, P. etal. 1994. Action video games and irforrral education: Effects on strategies for dividing visual attention. J oumal of Applied Develpmental Psychology 15: 
105-23. 

Gorriz, C., and C. Medina. 2000. Engagng grls with computers through software games. Cormrunications of the ACM 43: 42-49. 

Hara, K. 1996 A study of infbrrration skills instruction in elementary school: Effectiveness and teachers’ attitudes. PhDdiss., University of Toronto. 

Harris, J . 2001. The effects of computer games on young children — a review of the research. RD5 Occasional Paper No. 72. London: Research, Development and Statistics 
Directorate, Cormrunications Development Unit Home Office. 

Hirsh, S. 1998. Relevance determinations in children’s use of electronic resources: A case study. Proceed ngs of the 61st ASIS Annual Meeting 35: 63-72. 

Intersegmerital Committee of the Academic Senates (ICAS). 2002. Academic literacy A statement of competencies expected of students entering California’s pubic colleges 
and universities. www.uioiversitvafcalifcrnia.edLVsenate/reports/acadlitpdf . Accessed Dec. 4, 2006 

Irving, A 1985. Study arc! infbrrration skills across the curriculum London: Heinerrann. 

. 1990. VMder horizons: Online information services in schools. Library and Information Research Report 80. London: British Library. 

J oyce, M., andj . Tallrran. 1997. Making the writing and research connection vuth the I -Search Process. New York: Neal-Schurran 

Kelly, P. 1998 Transfer of learning froma computer simulation as compared to a laboratory activity. J oumal of Educational Technology Systems 26: 345-51 
Kuhlthau, C. 1987. An emerging theory of library instruction. School Ubrary Media Quarterly 16: 23-27. 

. 1988 Longtudinal case studies of the information search process of users in libraries. Library and Information Science Research 1G 257-304. 

Laffey, J . etal. 2003. Supporting learning and behavior of at-risk young children: Computers in urban education J oumal of Research Technology in Education 35: 423-40. 
Lee, J . 1999. Effectiveness of computer-based instructional simulation: A meta-analysis. International J oumal constructional Media 26 71-85. 

Loerke, K 1994. Teaching the library research process in junior Hcji. School Libraries in Canada 14: 23-26. 

Malone, T., and M. Lepper. 1987. Making learning fun: A ta>onomy of intrinsic motivation for learning. In Aptitude, learning and Instruction volume 3: Conative and affective 
process analyses, ed. R. E. Snow and M. J . Farr, 223-53. Hillsdale, N.J .: Lawrence Erlbaum Associates. 

Malouf, D. 1988. The effect of instructional computer games on continuing student motivation. TheJ oumal of Special Education 21: 27-38 

Mancall, J ., S. Aaron, and S. VNfelker. 1986. Educating students to think The role of the library media program School Library Media Quarterly 15: 18-27. 


Mark B., andT. J acobson. 1995. Teaching anxious students skills for the electronic library. College Teaching 43: 28-31. 


Nahl, D., and V. Harada. 1996. Corrposing boolean search statennents: Self-confidence, concept analysis, search logic and errors. School Library Media Quarterly 24: 199- 
207. 

National Center for Postsecondary I mprovernent (NCPI ). 2001. The landscape: A report to stakeholders on the condition and effectiveness of postsecondary education. 
Change 0 me): 27-42. 

National Cormrission on Excellence in Education. 1983. A nation at risk The i (operative for educational reform VN/hshington, D.C.: U.S. Government Printing Office. (ED 226 
006) 

National Council of Teachers of Mathematics (NC1M). 2000. Principles and standards for school mathematics. Reston, Va. : NC I M. 

National Research Council. 1996 National science education standards. \Adshington, DC: National Academy Pr. 

Newell, T. 2004. Thinking beyond the disjunctive opposition of information literacy assessment in theory/practi ce. School Library Media Research 7. 
vwwv. al a. orr^ala/miypE/di vs/aasl/aasl pcteandjoumals/sl rmfcy'sl mrcontents/vd ume72004/beyond. cfm Accessed Dec. 4, 2008. 

Neuman, D. 1995. High school students' use of databases: ResUts of a national Delphi study. J ocmal of the American Society for Information Science 46: 284-98. 

Pappas, M., and A Tepe. 1997. Pathways to knowledge: Fol lefts information skills model. McHenry, III.: Fd let! Software. 

Pitts, J . 1995. Mental models of information: The 1993-1994 AASL/Highsmith research award study. Schod Library Media Quarterly 23: 177-84. 

Prensky, M. 2001. Digital game-based learning. New York McGraw-Hill. 

Price, R. 1990. Computer-aided instruction: A gude for authors. Pacific Grove, Calif.: Brooks/Cde 
Provenzo, E. 1992. The video generation. The American Schod Board J oumal 179: 29-32. 

Quartern, B. 2003. Research skills and the new undergraduate. J oumal of Instructional Psychology, 30: 120-24 

Randel, J . et al. 1992. The effectiveness of games for educational purposes: A review of recent research. Simulation Gaming 23: 261-76. 

Rieber, L. 1996. Seriously considering play Designing interactive learning environments based on the blending of rricroworlds, simulations, and games. Educational 
Technology Research and Development 44: 43-58. 

Rivers, R., and E. Vockell. 1987. Computer simulations to stimJatesdentific prodemsdving. J oumal of Research in SdenceTeaching 24: 403-15. 

Robson, C. 2002. Real world research. New York Blackwell. 

Rosas, R. etal. 2003. Beyond Nintendo: Design and assessment of educational video games for first and second grade students. Computers & Education 4Q 71-94. 


Shaffer, D. etal. 2005. Video Games and the future of learning. PN Delta Kappan 87: 104-11. 

Shaffer, D. 2008. Hew computer games help children learn. New York: Palgrave Macrrillan. 

Sheingold, K. 1986. Keeping children's knowledge alive throucjo inquiry. School Library Media Quarterly 15: 80-85. 

Solomon, P. 1994. Children, technology and instruction: A case study of elementary school children using an online public access catalog (OP AC). School Library Meda 
Quarterly 23: 43-51. 

Stripling, B., andj . Pitts. 1988. Brainstorms and blueprints: Teaching library research as a thinking process. Englewood, Colo.: Libraries Unlimited. 

Thomas, N. 2004. Information literacy and information skills instruction: Applying research to practice in the school library media center. WEstport, Com.: Libraries Unlimited. 
Todd, J . 1995. Integrated information skills instruction: Does it make a difference? School Library Media Quarterly 23: 133-39. 

Todd, R. 1998. VWV, critical literades and learning outcomes. Teacher Ubrarian 26: 16-21. 

Van Eck R., andj . Dempsey. 2002. The effect of competition and contextualized advisement on the transfer of mathematics skills in a computer-based instructional 
simulation game. Educational Technology Research and Development 50. 

Vinvou, M., G. Katsionis, and K Manos. 2005. Combining software games with education: Equation of its educational effectiveness. Educational Technology Society 8: 
54-65. 

Wenger, E. 1998. Corrmuities of practice: Learning, meaning and identity. New York: Cambridge Univ. Pr. 

Wsconsin Education Media Association (V\£MA) and the American Association of School Librarians (AASL). 1993. I rformation literacy: A position paper on information 
problem solving. ERIC Document ED 376817. 

Webe, J ., and N. Martin 1994. The impact of a computer-based adventure game on achievement and attitudes in geography. J oumal of Computing in Childhood Education 
5: 61-71. 

Wolf, S., T. Brush, andj . Saye. 2003. Using an information problemsolving model as a metacognitive scaffold for multimedia supported information-based problems. J oumal 
of Research on Technology in Education 35: 321-41. 


Woodward, J ., D. Carmine, and R. Gerstem 1988 Teaching problemsolving throucjo computer simulations. American Educational Research J oumal 25: 72-86. 



ALA 


American 

Library 

Association 


Examining Information Problem-Solving, Knowledge, and Application Gains within Two Instructional Methods by Terrance S. Newell 
(Tables and Figures) 



Figure 1: Screen shot of the computer-mediated participatory simulation 



Figure 2: Screen shot of the middle school library with the computer simulation 



Figure 3: Screen shot of the high school library with the computer simulation 






Figure 4: Screen shot of an informal information environment with the computer simulation 



Figure 5: Screen shot of a student accessing an electronic resource within the computer simulation 


Table 1. Results for Hypothesis 1 

Entire Information Literacy Test 

Problem-Based Group 
(N =27) 

Simulation Group (N=27) 

T 

Significance 

M 

SD 

M 

SD 

Gain Score 

2.1482 

8.498 

16.963 

10.505 

1.852 

.04* 


Table 2. Results for Hypothesis 2 

Knowledge Section of Test 

Problem-Based Group 
(N=27) 

Simulation Group (N=27) 

T 

Significance 

M 

SD 

M 

SD 

Gain Score 

7.56 

8.285 

0 

6.794 

-3.664 

.000* 



Table 3. Results for Hypothesis 3 


Application Section of Test 

Problem-Based Group 
(N=27) 

Simulation Group (N=27) 

T 

Significance 

M 

SD 

M 

SD 

Gain Score 

4.96 

11.288 

16.67 

10.912 

3.873 

.000* 
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Appendix A. Pretest and Posttest Measure 


Best answer section [questions 1-10] 

1. A person that is skilled in the use of information should be able to: (select one of the following) 

o Read, write, and solve mathematical problems 
o Access, evaluate, and use information to solve problems 
o Read books, read websites, and search Google 
o Use many types of resources to solve problems 
o None ofthe above 

2. When you attempt to solve a problem using information, what should you do first? (select one of the following) 

o Look for a computer or a book 
o Find the needed information 
o Define the problem 

o Determine what type of information is need 
o None ofthe above 

3. When you attempt to solve a problem using information, what should you do last? (select one of the following) 

o Create a product 
o Use information 

o Organize and communicate solutions 
o All ofthe above 

4. Where should students go to find information? (select one of the following) 

o School libraries, public libraries, homes, and computer resources 
o Internet, databases, and electronic encyclopedias 
o Print, electronic, and human resources 
o None ofthe above 

5. What are good information sources? (select one of the following) 

o Sources that teachers and librarians give to students 
o Sources that answer your information question or problem 

o Encarta Encyclopedia, Britannia Encyclopedia, The Madison Times, and websites found using Google 
o Reliable information sources 
o None ofthe above 

6. This diagram was created by an information-literate student. Why do you think the student organized the information in this 



way? (select one of the following) 



o Because these are the types of diagrams that scientists make 
o To make sense of the information and to effectively present it to others 
o Because adding diagrams will increase her grade 
o Because this is the way that it appeared in the encyclopedia 

7. A good information problem solver can (select one of the following) 

o J udge accuracy and relevance 
o Read for facts, opinions, and point or view 
o Identify misleading and inaccurate information 
o Select appropriate information 
o Aii of the above 

8. What questions should you ask at the beginning of an information task? (select one of the following) 

o What is the end product? 
o How much time do I have? 
o What exactly am I being asked to do? 
o All of the above 

9. A good information problem solver can (select one of the following) 

o Organize information in the form of a product 
o Combine new information with what he or she already knows 
o Use information to satisfy an information need 
o Communicate information and ideas in appropriate ways 
o All of the above 

10. A good information problem solver can (select one of the following) 

o Clarify the requirements of a problem 
o Recognize the need for information 
o Form questions on the basis of information needs 
o Use keywords to better understand the problem 
o All of the above 

Problem-solving activity section 

Please read the scenario below and assist the person with their everyday information problem. 




Hi, my name is Nick and I could really use your help finding a job. Let me tell you a little bit about myself, and maybe 
you could suggest two appropriate jobs for me. 


In your own words, what is the problem? 

In your own words, what information do you need to find to solve the problem? 

In your own words, list some skills that you believe are needed to solve this problem 
List some resource formats that you could use to solve the problem. 

Use your computer to help Nick. Write your solutions to his problem on this page. Make sure thatyou explain your solutions. 

Appendix B. Rating Scale 

Scoring Guide 

1. A person that is skilled in the use of information should be able to: (select one of the following) 

o Access, evaluate, and use information to solve problems 

2. When you attempt to solve a problem using information, what should you do first? (select one of the following) 

o Define the problem 

3. When you attempt to solve a problem using information, what should you do last? (select one of the following) 

o All of the above 

4. Where should students go to find information? (select one of the following) 

o Print, electronic, and human resources 

5. What are good information sources? (select one of the following) 

o Appropriate sources that answer your information question or problem 

6. This diagram was created by an information-literate student. Why do you think the student organized the information in this 
way? (select one of the following) 

o To make sense of the information and to effectively present it to others. 


7. A good information problem solver can (select one of the following) 

o All of the above 

8. What questions should you ask at the beginning of an information task? (select one of the following) 

o All of the above 

9. A good information problem solver can (select one of the following) 

o All of the above 

10. A good information problem-solver can (select one of the following) 
o All of the above 

In your own words, what is the problem? 

Response rating =[1 2 3 4 5— is the highest] 

In your own words, what information do you need to find to solve the problem? 

Response rating =[1 2 3 4 5— is the highest] 

In your own words, list some skills that you believe are needed to solve this problem 
Response rating =[1 2 3 4 5— is the highest] 

List some resource formats that you could use to solve the problem. 

Response rating =[1 2 3 4 5— is the highest] 

Use your computer to help Nick. Write your solutions to his problem on this page. Make sure thatyou explain your solutions. 
Response rating =[1 2 3 4 5— is the highest] 



